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Camera Autofocus 

The present invention relates to cameras and in particular to autofocussing of cameras. 

Cameras use a lens arrangement to focus light onto an image receiving element which may 
be a film or in the case of a digital camera an image sensor, for example a charge-coupled device 
5 (CCD). Variable focus is desirable as otherwise the camera is limited to having a small aperture lens 
arrangement to achieve a sufficient range of focus. Variable focus of cameras may be achieved by 
use of a movable lens arrangement which is moved to vary the focus. Alternatively, variable focus 
may be achieved by use of a lens arrangement such as a liquid lens, the focus of which is variable 
electrically. 

10 Many elements of autofocussing cameras are very well known. Autofocussing (AF) camera 

systems have been described in broad terms many times. Fig.l shows a general schematic 
representative of known types of AF camera which employ an actuator 1 to move a lens arrangement 
2 which focusses light onto an image sensor 3. The image sensor 3 outputs an image signal to an 
image processor 4 which may include a storage medium. A focus controller 5 controls movement the 

15 lens arrangement 2 by outputting a control signal to a drive circuit 6 which supplies a drive signal to 
the actuator 1. The focus controller 5 controls the focus based on information from any of a number 
of sources as shown by the dotted arrows in Fig. 1 to find the best focus position. 

The focus controller 5 may use information from a physical range finder 7, for example an 
ultrasonic range finder (using a time-of-flight calculation) or an infra-red range finder (using a 

20 reflected luminance which is proportional to the square of the distance). 

The focus controller 5 may use information from optical elements placed in the optical path 
before the sensor, such as the shallow prisms or 'microscreens' found in SLR cameras. These can be 
analysed by a separate image sensor. 

The focus controller 5 may analyse the image signal output by the image sensor 3. This 

25 generally involves two separate processes. The first process is to determine a measure of the focus 
quality of an image. The second process is to control the focus of the lens arrangement 2 based on 
the determined measure of the focus quality, in accordance with some algorithm, for example to 
maximise the measure. 

Various measures of the focus quality of an image determined from the image signal are 

30 known. One type of measure is based on high spatial frequency content of an image. This type of 
measure is used on the basis that the high spatial frequency components increase with better focus. 
A first possibility is to integrate the modulus of high-pass filtered image data. A second possibility is 
to convolve the image signal with a high pass filter and find the power of the result. A third 
possibility is to perform a frequency domain transform (such as FFT or DCT) and apply a frequency 

35 domain filter and sum the power. These techniques all achieve the described effect, but behave very 
differently. 
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Another type of measure is based on statistics derived from the image signal, for example 
entropy measures and conversely compressibility of the image signal or a histogram or saturated 
pixel count. 

When variable focus is achieved by use of a movable lens arrangement, a piezoelectric 
actuator may be used to drive the movement of the lens. Use of a piezoelectric actuator provides 
various advantages over the use of an electric motor. One possible form of piezoelectric actuator is 
disclosed in WO-0 1/47041 and may be used in a camera as disclosed in WO-02/10345 1 . 

However, piezoelectric actuators commonly experience the problem of hysteresis in the 
drive signal input verses displacement output characteristic. This causes hysteresis in the position to 
which the lens arrangement is driven as a function of the control signal used to control the actuator. 
Hysteresis can be thought of as a process which has persistent state so that the behaviour at any 
moment in time depends on a history of preceding actions. Hysteresis causes a practical problem in 
the context of autofocussing because this involves variance of the control signal to bring the lens 
arrangement to the position in which the focus is best, or at least acceptable. However the result of 
hysteresis is that there is not in general a single value of the control signal corresponding to any 
given position such as the position of best focus. In practical terms, this makes it difficult to select 
the control signal necessary to bring the lens arrangement into focus. 

According to a first aspect of the present invention, there is provided a method of focussing 
a lens arrangement in a camera which further comprises an image sensor onto which an image is 
focussed by the lens arrangement and a piezoelectric actuator arranged to drive movement of the 
lens arrangement in accordance with a control signal applied thereto to vary the focus of the image 
on the image sensor, the piezoelectric actuator experiencing hysteresis in the position to which it 
drives the lens arrangement as a function of the control signal, the method comprising: applying a 
control signal to the piezoelectric actuator with a value at an extreme of a predetermined range; 
changing the control signal monotonically across the predetermined range and at each of a plurality 
of test values of the control signal during the change of the control signal determining a respective 
measure of the quality of the focus of the image from the image signal output by the image sensor; 
determining, from said respective measures of the quality of the focus of the image, a focus value of 
the control signal at which the quality of the focus of the image is at an acceptable level; changing 
the control signal back to said value at an extreme of said predetermined range; and changing the 
control signal monotonically to said focus value. 

Further according to the first aspect of the present invention, there is provided a camera in 
which such a method is implemented. 

According to a second aspect of the present invention, there is provided a method of 
focussing a lens arrangement in a camera which further comprises an image sensor onto which an 
image is focussed by the lens arrangement and a piezoelectric actuator arranged to drive movement 
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of the lens arrangement in accordance with a control signal applied thereto to vary the focus of the 
image on the image sensor, the piezoelectric actuator experiencing hysteresis in the position to 
which it drives the lens arrangement as a function of the control signal, the method comprising: 
applying a control signal to the piezoelectric actuator with a value at an extreme of a predetermined 
5 range; changing the control signal monotonically across the predetermined range and at each of a 
plurality of values of the control signal during the change of the control signal determining a 
respective measure of the quality of the focus of the image from fee image signal output by the 
image sensor; determining, from said respective measures of the quality of the focus of the image, a 
focus value of the control signal at which the quality of the focus of the image is at an acceptable 
10 level; determining a modified value of the control signal which is capable, by monotonic change of 
the control signal to the modified value, of moving the lens arrangement to the position at which it 
was located when the control signal was at the focus value of the control signal, taking into account 
the hysteresis of the piezoelectric actuator; and changing the control signal monotonically to said 
modified value. 

1 5 Further according to the second aspect of the present invention, there is provided a camera 

in which such a method is implemented. 

Both the first and second aspects involve initially applying a control signal at an extreme of 
a predetermined range and then changing the control signal momotonically across the predetermined 
range to determine a measure of focus quality at each of a plurality of test values of the control 

20 signal. 

As the focus control is always performed across the same predetermined range, the control 
signal never goes beyond the extreme of the range initially used. Advantage is taken of an 
observation of the physical phenomenon that when a piezoelectric actuator is operated with the 
control signal exclusively in a predetermined range, the position of the actuator at one end of the 

25 range tends to become the same position after a period of operation in the range. Thus the position at 
the extreme value of the control signal is repeatedly reached, at least after a few operations of the 
autofocussing control. This in turn means that the positions of the lens as the control signal is varied 
across the range are also the same every time the focus control is performed, as a result of the 
change being monotonic. This makes it possible to return the lens arrangement to one of those 

30 positions determined to provide the best, or at least an acceptable, focus quality, based on a 

determination of a focus value of the control signal during the initial scan at which the measure of 
the quality of the focus of the image is at an acceptable level. 

However the first and second aspects of the present invention use slightly different 
techniques for returning to the desired position, as follows. 

35 In accordance with the first aspect of the present invention, the control signal is changed 

back to said value at an extreme of said predetermined range, and then the 
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control signal is changed monotonically to said focus value. This returns the lens arrangement back 
to the same position at which it was located when the control signal was at the focus value as the 
position at the extreme value of the control signal is the same and the path followed by the actuator 
is the same. 

5 In contrast, the second aspect of the present invention does not require such a fly-back to the 

extreme value of the control signal and instead uses knowledge of the hysteretic properties of the 
piezoelectric actuator. In particular, there is determined a modified value of the control signal which 
is capable, by monotonic change of the control signal to the modified value, of moving the lens 
arrangement to the position at which it was located when the control signal was at the focus value of 
10 the control signal, taking into account the hysteresis of the piezoelectric actuator. This enables 
return to the same position simply by changing the control signal monotonically to said modified 
value. 

US-2003/1 175 14 discloses a method for using an image compression system to determine a 
measure of the focus quality of an image. The amount of data in the compressed image is 

1 5 determined as the measure of the focus quality of an image based on the principle that a well 
focussed picture contains more information than a poorly focussed image. Such a camera has the 
advantage that there is minimal cost in hardware in a camera when an image compression system is 
required anyway, as is typically the case to store images on a memory of the camera. Whilst such a 
technique does work in general terms, it does not always find the best focus. It would therefore be 

20 desirable to develop an autofocussing technique which provides a better degree of focussing. 

According to the third aspect of the present invention, there is provided a camera 
comprising: an image sensor arranged to generate an image signal; a lens arrangement which 
focusses an image onto the image sensor, the focus being variable in accordance with a control 
signal applied thereto; an encoder arranged to encode the image signal from the image sensor into an 

25 encoded signal compressed form; a control circuit arranged to control the focus of the lens 

arrangement by applying said control signal to the lens arrangement, wherein the control circuit is 
capable of controlling the encoder to operate in two modes, wherein in the first mode the encoded 
signal preserves low spatial frequency components of the image signal preferentially and in the 
second mode the encoded signal preserves high spatial frequency components of the image signal 

30 preferentially, and the control circuit is operative to control the focus of the image by: controlling 
the encoder to operate in said second mode; determining the amount of data in the encoded signal as 
a measure of the quality of the focus of the image on the image sensor; controlling the focus of the 
lens arrangement on the basis of the determined amount of data; and subsequently controlling the 
encoder to operate in said first mode. 

35 As compared to a camera which uses as the measure the amount of data in the encoded 

signal output by the encoder in its normal mode of operation (as for example in US-2003/1 175 14), a 
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camera in accordance with third aspect of the present invention provides a better measure of the 
focus quality and hence is capable of better controlling the focus of the lens arrangement. This is for 
the following reasons. 

The reasoning put forward in US-2003/1 1 75 14 that increased input information content 
5 directly corresponds to increased output file size is most true if a maximum entropy lossless coding 
has been used. However, in typical image encoding schemes used in cameras, there are employed 
lossy image compression systems including quantising elements which specifically discard 
information relating to higher spatial frequency components, for example by reducing the number of 
bytes available for coding or by omitting the high spatial frequency components entirely. As a result 
10 there is loss of information related to the high spatial frequency components which provide useful 
information on the focus quality, whereas there is retention of the low spatial frequency components 
which provide less useful information on the focus quality. 

For example, considering the common JPEG encoding scheme, a standard recommendation 
for luminance quantisation in the frequency domain is as follows: 
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where NC indicates this value is never coded. 



As can be seen, the spatial frequency values close to DC have the lowest quantisation and 
25 therefore represent the highest contribution to resulting file size, whereas higher frequencies are 
more coarsely encoded. 

However, in accordance with the third aspect of the present invention, to perform control of 
the focus, the encoder is put in a different mode of operation in which, relative to the normal mode 
of operation, it preserves higher spatial frequency components preferentially. Accordingly, in this 
30 mode of operation, the amount of data in the encoded signal is a better measure of the quality of 
focus. Thus, whereas the encoding in the normal mode of operation preferentially preserves low 
spatial frequency components because these components are desirable for aesthetically pleasing 
viewing, during focus control, the encoding preserves high spatial frequency components because 
these are more useful as a measure of the focus quality. This may be summarised as preserving 
35 focus information rather than visually useful information. 

For example the technique may be applied to a JPEG encoder comprising: a discrete cosine 
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transformation block arranged to transform the image signal into spatial frequency components; a 
quantisation block arranged to quantise the spatial frequency components output from the discrete 
cosine transformation block in accordance with a matrix of quantisation levels each in respect of a 
respective spatial frequency component; and an encoder block arranged to encode the quantised 
5 image signal in the frequency domain output from the quantisation block. 

In this case, the control circuit controls the encoder to operate in the two modes by causing 
the quantisation block to use different respective matrices of quantisation levels. Advantageously, 
the control circuit may in the second mode cause the quantisation block to use a matrix of 
quantisation levels which is the reciprocal of a matrix of spatial frequency coefficients of a high- 

1 0 pass filter, preferably the Laplacian of a Gaussian filter. 

When variable focus is achieved by use of a movable lens arrangement, during 
autofocussing it useful to know accurately the position of the lens arrangement at any given time. 
This facilitates control to bring the lens arrangement back to a position determined to be in focus. 
The control signal used to control movement of the lens may be insufficient for precise control, for 

1 5 example due to hysteresis, slippage or play in the actuator used to drive movement of the lens 
arrangement. 

Various position detectors for detecting the position of a lens arrangement are known, but 
these are often difficult or expensive to implement whilst still achieving sufficient accuracy. 

According to a fourth aspect of the present invention, there is provided a camera 
20 comprising: an image sensor arranged to generate an image signal; a lens arrangement which 

focusses an image onto the image sensor, the focus being movable to vary the focus of the image; a 
light source; an optical element fixed to and movable with the lens arrangement, and arranged to 
receive light from the light source and to direct it onto the image sensor, the optical element being 
arranged so that movement of the lens arrangement causes variation in the light incident on the 
25 image sensor; and a signal processor supplied with the image signal from the image signal and 
arranged to detect said variation in the light incident on the image sensor and, on the basis of the 
detected variation, to generate a measure of the position of the lens arrangement. 

Further according to the fourth aspect of the present invention, there is provided a 
corresponding method. 

30 Such detection of lens position is cheap and easy to implement. The only physical 

components associated with the lens arrangement are a light source and an optical element fixed to 
the lens. These components are simple and cheap to implement. The movement of the lens 
apparatus then causes a variation in the image signal output by the image sensor. This is 
straightforward to detect using a signal processor which is simple to implement as part of the 

35 processing circuitry which is present in the camera for other processes. For example, one 

possibility is for the signal processor to be implemented by a microprocessor running a program. 
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Given that the camera will include a microprocessor anyway, this example only requires a software 
change and no cost in additional hardware. 

The camera may comprise a controller arranged to control the movement of the lens 
arrangement to vary the focus on the basis of at least the generated measure of the position of the 
5 lens arrangement. 

Preferably, the optical element is a reflector, for example a mirror, arranged at an angle of 
greater than 0° to the axis along which the lens arrangement is movable. In this case, movement of 
the lens arrangement causes change in the location on the reflector where reflection occurs and 
hence the variation in the light incident on the image sensor is a movement of the light across the 

10 image sensor. This is straightforward to detect in the image signal. However, in general any optical 
element which causes variation in the light incident on the image sensor on movement of the lens 
arrangement could be used. 

Preferably, the light source emits a beam of light. This makes it easy to detect the light 
form the light source in the image signal. 

15 To allow better understanding, embodiments of the present invention will now be 

described by way of non-limitative example with reference to the accompanying drawings, in 
which: 

Fig. 1 is a schematic representation of some known autofocussing cameras; 
Fig. 2 is a block diagram of a camera; 
20 Fig. 3 is a flowchart of the operation of the camera of Fig. 2 

Fig. 4 is a graph of position vs. control signal for a piezoelectric actuator experiencing 
hysteresis; 

Fig. 5 is a flow chart of an autofocussing method; 

Fig. 6 is a graph of position vs. control signal for a piezoelectric actuator operated in 
25 accordance with the autofocussing method of Fig. 5; 

Fig. 7 is a cross-sectional view of a position detection system; 

Fig. 8 is a cross-sectional view of a first modified position detection system, perpendicular 
to the optical axis; 

Fig. 9 is a cross-sectional view of the first modified position detection system, along the 
30 optical axis; 

Fig. 10 is a cross-sectional view of a second modified position detection system, 
perpendicular to the optical axis; 

Fig. 1 1 is a cross-sectional view of the second modified position detection system, along 
the optical axis; and 

35 Figs. 12 to 16 are flow charts of various specific autofocussing operations. 

There will first be described a camera 20 which is shown in Fig. 2. 
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The camera 20 has a variable focus lens arrangement 21 which focusses light onto an 
image sensor 22 which in turn produces a video image signal in response to the incident light. The 
variable focus lens arrangement 21 is movable to vary the focus. Such movement is driven by an 
actuator 23. The actuator 23 may be a piezoelectric device, for example as of the type disclosed in 
5 WO-01/47041 which can drive movement of the lens arrangement 21 as disclosed in WO- 
02/10345 1 . In this case, the lens arrangement 21 may be suspended using a suspension system 
incorporating the actuator 23 as disclosed in WO-2005/003834. 

The actuator 23 is driven by a control signal supplied by a drive circuit 24. 
The image signal from the image sensor 22 is supplied to a JPEG encoder 25 which is 
10 operable to encode the image signal in accordance with the JPEG standard. This encoding involves 
lossy compression. In particular, the JPEG encoder 25 comprises the following components. 

The image signal is first supplied to a colour processing block 26 which performs post- 
processing of the image signal from the image sensor 22. 

The image signal is then supplied to a discrete cosine transformation block 27 which 
15 performs a discrete cosine transformation of the image signal into spatial frequency components. 

The spatial frequency components are supplied to a quantisation block 28 which quantises 
the spatial frequency components in accordance with a matrix of quantisation levels in respect of 
respective spatial frequency components. The quantisation block 28 is operated in a manner 
described in more detail below. 
20 The quantised spatial frequency components are supplied to an encoder block 29 which 

encodes the quantised spatial frequency components, for example using a run-length encoding 
scheme. 

The output of the encoder block 29 is supplied as the encoded signal output by the JPEG 
encoder 25. The encoded signal may be supplied to any other components of the camera, for 
25 example to a memory 30 for storage or to a driver 3 1 arranged to process the encoded signal for 
display of the image on a display 32. 

The camera 20 operates under the control of a control circuit 33 usually implemented by a 
microprocessor running an appropriate program. The JPEG encoder may be implemented in 
hardware or in software by a microprocessor running an appropriate program, which may be the 
30 same microprocessor used to implement the JPEG encoder. 

The operation of the quantisation block 28 will now be described in more detail. The 
quantisation block is capable of operating in two modes in which a different quantisation matrix is 
applied. The selection of the mode is performed by the control circuit 33. hi Fig. 2 this is 
illustrated as being achieved by the quantisation block 28 comprising two quantiser blocks 34 and 
35 35 each performing quantization in accordance with a different quantisation matrix and a switch 
36 switchable to select the output of one of the quantiser blocks 34 and 35 as the output of the 
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quantisation block 28, the switch 26 being controlled by the control circuit 33. As an alternative, 
the quantisation block 28 could be controlled by the control circuit 33 selectively changing the 
quantisation matrix used by the quantisation block 28. 

The two quantisation matrices used in the two modes of operation of the quantisation 
5 block 28 are as follows. In the first mode the quantisation block 28 uses a quantisation matrix of 
the type normally selected in a JPEG encoder in accordance with the JPEG standard. As an 
example, one possible form for the quantization matrix is set out above in the discussion of the 
present invention. In such a quantisation matrix, the low spatial frequency components are 
preserved preferentially, as compared to the high spatial frequency components. This is done in 

10 order to perform compression whilst preserving the low spatial frequency components which is the 
information in the image signal most important for a visually acceptable image! Effectively this 
involves discarding of information contained in the high spatial frequency components. As a result 
the encoded signal output by the JPEG encoder 25 in this mode of operation is not reliable as 
providing information on the quality of focus which affects most significantly the high spatial 

15 frequency components. 

In the second mode the quantisation block 28 uses a quantisation matrix which preserves 
high spatial frequency components preferentially, as compared to the first mode. The quantisation 
matrix is therefore selected to preserve information which is useful for determining the focus 
quality of the image signal. In principle the quantization matrix in the second mode may take any 

20 form which preserves the high spatial frequency components useful for providing information on 
focus quality, but the design may be simplified by using a quantization matrix which is the 
reciprocal of a high-pass filter. This allows use of any high-pass filter which extracts high 
frequency components useful for determining the focus quality. 

One possible high-pass filter is a Laplacian of a Gaussian filter. The continuous version of 

25 this function is; 

r 

where x and y are spatial co-ordinates,./^ y) is the spatial domain filter, and r is the radius of 
the Gaussian blur. The Laplacian is a differential operator which gives increasing gain with 
frequency. The Gaussian is a blur operation which rolls off the gain at high frequency. One 
30 advantage of this filter design is that it is easy to understand its operation in terms of spatial 
performance. The Gaussian blur radius r is specified in pixels and is related to the size of the 
smallest detail that is believed to be "real" (and not noise) in the image. Another advantage of this 
function is that it is circularly symmetric. After transformation by a discrete cosine transformation, 
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image components which correspond to asymmetric cosines must become zero, that is about 75% 
of the resulting coefficients. Additionally, the resulting coefficient matrix must be symmetric 
which potentially halves the number of multiplies. As an example, with a matrix of 8 by 8 values, 
after the transformation there are 1 8 non-zero values and the symmetry reduces the number of 
5 multiplies to 9. Furthermore, coefficients can be scaled such that they can be reasonably 
represented in the form 2 n , that is a shift operation in a binary digital processor, or some simple 
combination of a few shift and add operations. 

An example of the quantisation matrix which is the reciprocal of the Laplacian of a 
Gaussian filter is: 
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where M represents the maximum possible quantisation. This quantisation matrix is given for just 
one scaling at one Gaussian radius value r, but of course other values of these parameters could be 

20 used. It is believed that the quality of result is not strongly dependent on the scaling of the 
quantiser matrix, and therefore there are many valid variants of this matrix. 

As the second mode results in the preservation in the encoded signal of high spatial 
frequency components which provide useful information on the focus quality, the control circuit 
33 uses the amount of data in the encoded signal when the JPEG encoder 25 is in the second mode 

25 as a measure of the quality of focus. The amount of data increases as the quality of focus increases 
because focussing by its very nature increases the magnitude of the high frequency components. 
Thus a lower degree of compression and hence a higher amount of data occurs as the focus 
improves. Use of the alternative quantisation matrix in the second mode provides a better measure 
than if the normal quantisation matrix is applied, as in the first mode, because the normal 

30 quantisation matrix discards information which is relevant to focussing. 

To illustrate this, the autofocus operation of the camera 20 performed by the control circuit 
33 is shown in Fig. 3. 

Firstly, in step SI the control circuit 33 switches the JPEG encoder 26 into the second 
mode so that the encoded signal is derived using the quantisation matrix which preserves high 
35 spatial frequency components containing information useful for focussing. 

Next, in step S2 autofocussing is performed using the amount of data in the encoded signal 
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output from the JPEG encoder 25 as a measure of focus quality. The autofocussing step S2 is 
described in more detail below but results in the actuator 23 being controlled to move the lens 
arrangement 21 to the position of best focus or at least a position where the focus is acceptable. 
After autofocussing in step S2 has been completed, in step S3 the control circuit 33 
5 switches the JPEG encoder 25 into the first mode so that the encoded signal is derived using the 
quantisation matrix which preserves low spatial frequency components containing information 
which provides an image of good visual quality so far as possible. Subsequently, in step S4 the 
camera is operated normally to cause the JPEG encoder 25 to output encoded signals representing 
images captured by the image sensor 22. 

10 Although the camera 20 is described as including a JPEG encoder in accordance with the 

JPEG standard, it could equally be applied to other types of encoder which provide lossy 
compression of the image signal output by the image sensor 22. 

There are, of course, a variety of loss mechanisms which have been specified in many 
common image compression standards. Some of these cannot be adapted for the purposes of 

15 preferentially preserving focus information to image information, for example, where they relate to 
colour depth reduction or chroma subsampling which are normally fixed as part of the 
compression standard. However many of the loss mechanisms are controllable loss mechanism, as 
in the quantisation performed in the JPEG standard In most cases, the principal controllable loss 
mechanism is a quantisation or a threshold operation, it being noted that a threshold operation can 

20 be thought of as a special case of quantisation. Of course, other controllable loss mechanisms are 
conceivable and may be used. For example, it is possible to drop low probability codes in the 
entropy coding of the stream and the present technique could be applied to that. 

The present technique may be applied to other encoding schemes by controlling the 
variable loss mechanism to operate differently in two modes of operation, the first preserving low 

25 spatial frequency components containing information which provides an aesthetically pleasing 
image and the second preserving high spatial frequency components containing information which 
is useful for focussing. 

In general, more than one setting may be necessary in the second mode because the 
optimal setting may change with parameters such as the overall scene light level as high-pass 

30 filtered images are sensitive to noise, and pictures tend to become noisier at low light level This 
can be detected through the exposure time of the image sensor 22, and the effective high-pass filter 
can be switched on the basis thereof, for example to a less aggressive high frequency gain as the 
exposure time increases. 

The settings in the two modes, for example the quantisation matrices in the camera 20, can 

3 5 either be designed from knowledge of the desired spatial response or frequency response or they 
could be derived by direction optimisation of heuristic criteria, for example by running trial data 
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sets which have had notional scores of focus quality and aesthetic value attached, and then varying 
the parameters of the controllable loss mechanism until there is a correlation. The latter method is 
more suited to controllable loss mechanisms in which the action of the loss mechanism cannot be 
trivially inverted into a source image manipulation. 
5 As an example of another encoding scheme, the technique can be applied to a wavelet 

compression scheme, such as a 3 level recursive Discrete Wavelet Transform using a Daubechies 
6th order polynomial. In this case, the loss mechanism may be controlled by variation of a 
threshold to which the transformed image signal is subjected to remove (force to zero) a certain 
proportion of the wavelet coefficients. Wavelet transforms have an interesting side-property that 
1 0 some spatial location is preserved at every frequency scale. It is therefore easy to select a region of 
interest within the image by zeroing out wavelet coefficients corresponding to spatial locations 
outside the region of interest. 

The autofocussing step S2 will now be described in detail. 

In the camera 20 the control signal applied by the drive circuit 24 to the actuator 23 is a 
15 voltage signal. Preferably the actuator 23 is a piezoelectric actuator as described above. The 

piezoelectric material in such an actuator 23 typically exhibits hysteresis and this generates a 

problem in autofocussing. 

The nature of the hysteresis is illustrated in Fig. 4 which is a graph of the position to which 

the lens arrangement 2 1 is moved as a function of the control signal. In particular, the position 
20 does not depend linearly on the value of the control signal (for example along the dotted line) but 

instead the position depends on the history of the changes in the control signal. Fig. 4 illustrates a 

series of positive and negative changes in the control signal. The control signal starts and finishes 

at the same value but the position starts and finishes at different values. Hysteresis means that the 

position of the lens arrangement 21 at any given point in time is not in general known from the 
25 control signal which is the only parameter being controlled. This makes it difficult to perform 

autofocussing because the position of the lens arrangement 21 determined to give the best focus, or 

at least an acceptable focus, cannot easily be returned to. 

However, the camera 20 deals with this problem of hysteresis by performing the 

autofocussing step using a method which will now be described with reference to the flow chart 
30 shown in Fig. 5. 

The method relies on always applying a control signal within a predetermined range and 
makes use of a physical phenomenon illustrated in Fig. 6 which is a graph of the position to which 
the lens arrangement 21 is moved as a function of the control signal. In Fig. 6, the extreme values 
of the predetermined range for the control signal are S MIN and S^. It is observed that when the 
35 control signal remains within the predetermined range, after an initial period of stabilisation, the 
piezoelectric actuator 23 enters a state in which the position at the ends of the predetermined range 
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tends to respective constant values, shown as P^ and P MAX in Fig. 6. Thus, whenever the control 
signal is changed to one of the extreme values S Mm or S,^, the position changes to the same value 
Pmjn or P^, respectively. Similarly, when the control signal is changed monotonically from one 
of the extreme values or S MAX , the position changes along the same curve 90 or 91, 
5 respectively. Thus it is possible to drive the lens arrangement 21 to the same positions repeatably 
and predictably by first applying a control signal at one of the extreme values S MIN or S MAX and 
then changing the control signal monotonically. This effectively provides knowledge about the 
relative position of the lens arrangement 21 which is used by the autofocussing method, as follows. 
The repeatable changes only occur after an initial period of operation in the predetermined range 

10 of the control signal. However, in practice, this stabilisation occurs after a relatively small number 
of cycles of the autofocussing method. 

In the autofocussing method, initially in step SI 00 the applied control signal is one of the 
extreme values S MIN or S MAX . This may require the control signal to be changed, or in some 
embodiments the control signal may already be at the appropriate value, for example because this 

15 is the rest state of the piezoelectric actuator 23. For simplicity, there will be described the case that 
the lowermost extreme value S^ is used initially and the control signal is subsequently raised, but 
alternatively the uppermost extreme values can be used initially in which case the following 
still applies but applying increases instead of decreases and vice versa. 

Next in step S101, the control signal is changed monotonically across the predetermined 

20 range. This scans the lens arrangement 21 across a corresponding range of positions. At each of a 
plurality of test values of the control signal across the predetermined range, the measure of focus 
quality is determined and stored. The test values may be disposed linearly across the 
predetermined range but this is not necessary. Alternatively the test values may be unequally 
spread, for example concentrated in a particular part of the range. At the end of step S 10 1, the 

25 control signal is at S MAX , so the position of the lens arrangement 21 is P MAX . 

In Step S102, the determined measures of focus quality are used to derive a focus value of 
the control signal at which the focus quality is at an acceptable level. Most simply this is done by 
selecting the one of the plurality of test values having the best measure of focus quality. As an 
alternative, it is possible to predict the value of control signal providing the best focus from the test 

30 values using a curve-fitting technique. Thus the focus value need not be one of the test values. The 
curve fit can be by a simple arithmetic equation, such as an Mth order polynomial, where M>1, or 
instead could be chosen as a best- fit to a curve taken from a library of curves pre-measuxed from 
representative scenes. There are numerous enhancements which can be made to such a scheme, for 
example: 

35 • In the case where the estimate is taken from an ensemble of representative scenes, then the 
algorithm can learn over time, appropriate scales and offset values. That is, the physical unit will 
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differ from the reference unit with which the data ensemble was recorded (due to mechanical and 
material tolerances). The algorithm can develop a model of how the library values map to the 
actual values required for a particular system. 

Bayes theorem is a powerful tool in this context. The distribution of errors between the 
5 'correct' measures of focus quality for a scene and the measured measures of focus quality (which 
is perturbed by instantaneous factors such as noise) can be reasonably well estimated. Even in the 
case of simple 'hill climbing', Bayes Theorem provides a method for distinguishing signal from 
noise. 

Although Steps 101 and 102 are illustrated separately in Fig. 5, step SI 02 could be 

10 performed at least in part during the scan performed in Step S101. 

For the reasons set out above, the position at which the lens arrangement was located when 
the control signal was at the focus value during the scan of Step S 101 is known, at least relative to 
the positions P^ and P MAX at the extremes of the predetermined range. For example in the case 
that the focus value of the control signal is Sd shown in Fig. 6, then the position is Pd. Thus it is 

15 straightforward to return to that position. Two alternative ways to do this are shown in Fig. 5, 
namely by performing steps SI 03 and SI 04 or by performing steps SI 05 and SI 06. 

In the first alternative, the method proceeds to step SI 03 in which the control signal is 
changed back to the initially applied extreme value of the control signal S^ or Sj^. Thus the 
lens arrangement returns to the same position as it occupied as a result of step SI 00. Thus, this 

20 alternative is referred to as a fly-back technique. The control signal may be changed during this 
fly-back step SI 03 at a greater rate than during the scan step SI 01 because it is not necessary to 
perform any calculations to determine the measures of focus quality. 

Next in step SI 04, the control signal is changed monotonically to the focus value 
determined in step S102. This causes the position of the lens arrangement to change along the 

25 same curve as during the scan step S101 (for example along curve 90) and hence to arrive at the 
position at which it was previously located when the control signal was at the focus value (for 
example Pd if the focus value is Sd). Accordingly, the fly-back technique returns the lens 
arrangement back to the position determined in step SI 02 in a reliable manner despite the 
hysteresis of the piezoelectric actuator. 

30 The autofocussing method employing a fly-back technique can operate very quickly, and 

in particular, in a usefully short time. This can be demonstrated by considering for example a 
camera 20 with an F2.8 aperture and a focussing lens arrangement 21 with focal length of 4.25mm. 
For a 3. 6um pixel-pitch sensor, we can set the circle of confusion to 10.2um, i.e. the diagonal of a 
2x2 pixel block, the smallest all-colour imaging element in a colour sensor. With these constraints, 

35 the range of focus from 10cm to infinity can be covered in 4 depth-of-field ranges (centred at 
1 17mm, 169mm, 292mm and 633mm). To allow for the non-ideal characteristics of the total 



WO 2005/091067 



PCT/GB2005/000964 



-15- 

optical system, such as gravity, hysteresis, angular tolerance between lens and sensor etc, it would 
be prudent to allow for 6 depth-of-field ranges. In good light conditions so that the exposure time 
is short compared with the frame time, the device movement between adjacent depth-of-field 
ranges can be completed in the non-exposed portion of one frame when running at 30fps or slower, 
5 a frame rate which is common in such cameras. Experiments have shown that a fly-back time as 
small as 15ms works correctly. Therefore the method can complete in the following time: 

1 x 15ms (for initial fly-back in step S100 if necessary) 

+ 6x33ms (to scan and test in step S101) 

+ 1x15ms (for fly-back in step S103) 
10 + 1 x 3 3ms (to return the to focus position in step 1 04) 

= 261ms 

This autofocus cycle time, just over Va second, compares very favourably with many 
alternative systems. 

However, the second alternative reduces the cycle time by avoiding the fly-back of step 

15 S103 and instead changing the control signal directly to the appropriate value which may be 
determined based on a knowledge of the properties of the piezoelectric actuator 23. In particular, 
in S105 there is determined a modified value of the control signal capable, on monotonic change of 
the control signal to the modified value, of moving the lens arrangement 21 from its current 
position at the end of step S101 to the position at which it was located during the scan step S101 

20 when the control signal was at the focus value determined in step SI 02. In general in the example 
of Fig. 6 the modified value of the control signal may be derived from the curves 90 and 91. For 
example, in the case that the focus value of the control signal is Sd, the position of the lens 
arrangement 21 when the control signal was Sd during the scan step SI 01 is Pd and the modified 
value of the control signal is Sm, 

25 Thus the modified value may be determined from the properties of piezoelectric actuator 

21 because of the operation within the predetermined range, as described above. The determination 
of the modified value is straightforward because the material properties can be well controlled in a 
production situation. In general, the determination may be performed using a look-up table stored 
in the camera 20 or brute calculation of hysteresis estimates. In the case of a look-up table, the 

30 knowledge of the hysteretic properties are used to derive the values stored in the table in advance. 
Where calculation is performed in the camera 20, the knowledge of the hysteretic properties is 
embodied in the calculations stored in the camera 20. 

In principle, the determination of a modified value of the control signal may also take into 
account other factors such as changes in the environmental conditions of the unit (particularly 

35 temperature), the orientation, location of end stops and other physical and mechanical parameters. 
Detailed methods of performing the autofocussing step S2 are shown in Figs. 12 to 16 
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which are flow charts of the operation performed by the control circuit 33. These methods (and 
indeed the methods of Figs 3 and 5) are merely part of the operation of the entire camera 20, 
autofocus itself simply being one of the many operations necessary for the camera 20 to perform a 
useful function, the other operations possibly including, calibration of the sensitivity to light and 
5 appropriate closure of the aperture and/or change of exposure time, the "taking" of the picture (ie 
the final exposure to be captured and stored), and the transfer of the captured image from the 
image sensor 22 of the camera 20 to the memory 30. For this reason the flowcharts of Figs. 12 to 
16 have START and RETURN control points S10, SI 1, S20 and S28. The START point S10 is 
where the overall or general camera control system begins the autofocus process, and the 

10 RETURN points SI 1, S20 and S28 is where this iteration of the autofocus process is complete and 
general camera control method (hereinafter the General Camera Control Method or GCCM) 
continues before later re-entering the autofocus control method (hereinafter the Autofocus Control 
Method or ACM) again. 

Fig. 12 is a simplified flowchart which underlies all of the more detailed methods 

15 described subsequently. 

Once the ACM is entered via the START box S10, the first operation S12 is to initialize to 
suitable values the loop variables that are used to control the details of the rest of the method. The 
ACM also has a State variable that persists from one invocation of the method to the next, 
although the ACM itself may change the value of the State variable. The essential point is that 

20 when the method returns control to the GCCM, the State is not lost, and unless deliberately 
changed by an external system e.g. the GCCM itself, the State variable will have the same value 
the next time the ACM is initiated. 

Next in step S 13 the State variable is checked and if the ACM is in Idling state (which 
means "do nothing") the ACM returns control directly to the GCCM. 

25 In step S14 it is checked if instead the State is Initialisation state (which means, "prepare 

for anew focus measurement process cycle of operations"). If so in step S15 certain focus control 
variables are initialised to suitable values (including the frames variable). This corresponds to step 
SI 00 of the flow chart of Fig. 5. After this in step S16 the frames variable is incremented. 

A test is then carried out in step S17 to check if all the required frames have been done. If 

30 so, the State is moved to the next state in step SI 8, ie the State variable value is changed. In either 
case in step S20 the ACM then returns control to the GCCM and passes back a value currpos 
which describes the current focus-lens position. 

If step S14 determines the State is not Initialisation state in step S 19 it is checked if instead 
the State is Running state. If so the measure of focus quality (referred to in the flowchart as Figure 

35 of Merit (FOM)) is determined in step S20 for the image being received by the camera 22 with the 
lens arrangement 21 at its current position (currpos). This newly derived FOM is then compared in 
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step S21 with any previous FOM values determined since the last Initialisation state. If the new 
FOM is the best so far, then it is remembered in step S22 as a new value of best FOM so far, for 
future FOM comparisons. In either case, the ACM then works out how to alter the position of the 
lens arrangement 21 on the basis of this FOM measurement. Then the method goes to step SI 6 and 
5 continues as above. This corresponds to steps S101 and S102 of the flow chart of Fig. 5. 

If step SI 9 determines the State is not Running state, it is checked in step S24 if the State 
is Flyback. If so, in step S25 the ACM causes the lens arrangement 21 to move to a known 
position. Then the method goes to step S16 and continues as above. This corresponds to steps 
S103 and S104 or to steps S105 and S106 of the flow chart of Fig. 5. 
10 If step S19 determines the State is not Flyback state, it is checked in step S26 if the State is 

Track Focus. If so, in step S27, the frames variable is set to a large number,, so that the rest of the 
algorithm will process many frames before it registers all required frames done. Then the method 
goes to step SI 6 and continues as above. Otherwise, if in none of the above states are dteremined, 
in step S28, the State is set to Idling and the GCCM is returned to. 
15 Figs. 13 to 16 show modified versions of the ACM of Fig. 12. The flowcharts of Figs. 13 

to 15 implement steps S103 and S104 of Fig. 5, whereas the flowcharts of Fig. 16 implements 
steps S105 and S106 of Fig. 5. 

Fig. 13 shows a first specific implementation in which a description of the loop variables 
and their initialised values can be seen. These include the number of initial steps, initSteps = 5 and 
20 flyback steps, flybackSteps = 5, the number of scan steps, scansteps = 25 , a zero value for the 
frames done variable frames and an upper limit for the drive value, DrivMax = 255, which is 
specific to each and every implementation, and simply represents the maximum allowable value 
for the lens position drive signal. 

When the state on entry to the routine is initialisation, State = init, then specific values for 
25 the focus variables are defined in step S15 as follows: best position bestPos = 0, current position 
currpos = 0, best Figure of Merit bestFOM = 0, and number of frames frames = initSteps. 

If in the running state, State - running, then in step S20 a current FOM value thisFOM is 
calculated by a call to a sub-process getFOM (described below in two preferred formats, but any 
suitable method of determining an FOM can be used here); this FOM is then checked in step S21 
30 against the current best FOM, bestFOM, and if the new value is better, then bestFOM is updated in 
step S22 with the value of thisFOM, and the focus lens position for best FOM, bestPos is updated 
from the current position currPos. Then a new lens position currPos to try is calculated in step 
S23, and the frames variable updated. 

If the system is in the flyback state, State = Flyback, then in step S25 the next lens position 
35 is set to 0, currpos = 0, and the frames variable set to a suitable value for the flyback process, 
=flybacksteps in this version, after which the StateFrarae variable is incremented in step S 16 (NB 
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in the flowcharts the notation -H-x is used to indicate that the variable x is incremented (by 1)). 

If the system is in the tracking state, State = track, then in step S27 the frames variable is 
set to 100 in this version, before the Stateframe variable is incremented in step S16. 

These latter states than pass to a test to see if all required frames are done by comparing 
5 Stateframe with frames in step SI 7, and if so, the system state is modified in step S 18 according to 
its current state (init changes to running, running to flyback, flyback to Idle, Track to Track (i.e. no 
change) and Idle to Idle (again, no change of state)). The last action is to move the lens to the 
newly computed position currpos by a call to the focal lens movement control routine Focusf). # 
the entry state was any other state, then the state is set to Idle before returning. 
10 In the above description all the constant values to which the various variables are set to 

during the process are example values that have ben found to work well, but other values are also 
possible and useful in real implementations and these given here are merely guides to one 
particular implementation and are not meant to be limiting. 

Fig. 14 shows a second variant of the basic autofocus algorithm, very similar to that in Fig. 
15 1 3, the principal changes being: 

(1) In the initialization step S 12 initSteps = flybacksteps « 3 (instead of 5) and ScanSteps = 15 
(instead of 25); and 

(2) In the running state in step S23, the new position is calculated differently, that is by currpos = 
(StateFrame+ l)*Drivemax/scansteps. 

20 Fig. 1 5 shows another slight variant of the method shown in Fig. 1 3 , the principal 

differences being: 

(1) In the running state, in step S23 the new position is calculated differently, that is by currpos = 
StateFrame*Drivemax/scansteps; 

(2) After the test for all frames is done in step SI 7, an extra test is inserted in step S 18 if the state 
25 is running, to see if the best position is greater than a certain large value (in this example, bestPos 

> 230?), and if the test succeeds then instead of moving to flyback state instead the system moves 
to idle state, after resetting the next position to the latest best-position, currpos = bestPos, just prior 
to the instruction to move to that new position. Alternatively, if the state is flyback, then state is 
reset to idle and again currpos is set to bestPos. 

30 Fig. 16 is yet another variant of autofocus control method, with an element of dead- 

reckoning built into it, designed to reduce the effects of any hysteresis in the actuator that converts 
an electrical drive signal into a mechanical position for the focal-lens. Clearly hysteresis in such a 
component will cause the lens to move to different positions for the same drive signal due to the 
previous history of mechanical and drive states, so that depending on these histories, methods 

35 ignoring hysteresis will behave differently at different times, and in general less well than if 
hysteresis were absent. 
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In Fig. 1 6, the principal differences from the previous methods described are that: 

(1) in the tracking state, the method uses the same control state sequence as the flyback state; and 

(2) after the test for all frames done has been satisfied, step S18 is modified by the inclusion of 
sub-step SI 8a so that if the system is in the running state, then the next new position of lens, 

5 currpos is computed by use of a look up table (LUT) using the stored bestPos value is the index 
into the table. This lookup table will contain pre-computed (static at design, assembly or test time, 
but possibly dynamically controlled values of position data, estimated to correct for the actual 
hysteresis of the actuator element). 

The various control methods of Figs. 3, 5 and 12 to 16 are described above by way of 

10 flowcharts representing the operation of the control circuit 33. However the actual implementation 
of the camera 20 and these the methods in an actual camera 20 is a matter of engineering choice, 
and could be different, for example hard-wired control logic, a set of gates, registers and memory 
, cells in a field programmable logic array, or a general purpose DSP (digital signal processor) or 
microprocessor connected to input and output circuitry, executing a program that causes the 

1 5 ensemble to enact the control method. Similarly other possibilities exist and may be used. 

Above it is described that the control signal output by the driver 24 is a voltage signal. As 
an alternative the control signal may be charge signal. This may be derived for example by 
integration of the current applied to the actuator 23. An example of suitable charge control is 
disclosed in WO-02/080353. This has the advantage that the hysteresis experienced by the 

20 piezoelectric actuator 23 is greatly diminished, that is the relationship between charge signal 
applied to the actuator 23 and position of the lens arrangement 21 has a reduced degree of 
hysteresis. All that is necessary is to monitor the charge entering and leaving the piezoelectric 
actuator instead of monitoring the drive voltage applied to it. To a good approximation, it may be 
assumed that there is no hysteresis, in which case the autofocussing method shown in Fig. 5 may 

25 be applied without the fly-back step S103, but instead after step S102 immediately changing the 
control signal to the focus value determined in step S102. However, there may remain some 
hysteresis so as an alternative the autofocussing method shown in Fig. 5 may be applied in full. 

The disadvantage of using a charge control signal is that the driver 24 is more complicated 
to implement. 

30 In the autofocus operations described above, the knowledge of the position is only derived 

from the value of the control signal, this being the reason why it is necessary to perform the type of 
autofocussing operation shown in Fig. 4 to take account of hysteresis. As an alternative it is 
possible to detect the position of the lens arrangement 3 directly. Then the detected position may 
be used to provide positional feedback which makes the problem of hysteresis easy to solve. A 

35 simple controller (PID, for example) can be easily used to return the lens to the position of best 
focus achieved during an initial focus measuring scan as previously described. In this case, a 
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positional feedback system measuring a quantity directly related to the position of the lens 
arrangement within in its range of travel is used to provide a signal to return the lens arrangement 
to the position of optimal focus as determined by a focus scan process similar to that described 
above in steps SI 00 and SI 02 above. 
5 In a camera detection of position be performed in several ways. 

One option is to use a strain gauge. A strain gauge could be attached or printed onto a 
component of the lens arrangement, such as a supporting hinge or flexure. In the case that the 
actuator is a piezoelectric actuator of the type disclosed in WO-01/47041, or another type of 
piezoelectric actuator having a bender construction, a strain gauge can be incorporated into the 

10 structure of the actuator itself, for example as disclosed in GB-A-2,365,206. 

Another option is to use a light source and an optical element fixed to the lens arrangement 
21 to direct light to the image sensor 22 so that the light varies with the position of the lens 
arrangement. An example of such a system is shown in Fig. 7 and will now be described. ■ 

The lens arrangement 21 comprises a lens 100 mounted in a lens barrel 101 so that it is 

15 movable along the optical axis O of the lens 100. The lens barrel 101 has an end wall 102 on the 
output side of the lens 100 with an aperture 103 through which light focussed by the lens 100 is 
directed onto the image sensor 22. The end wall 102 of the lens barrel 101 has on its outer side a 
block 104 having a reflective surface 105 extending at an angle greater than 0° to the optical axis 
O along which the lens 100 is movable. 

20 The system further includes a light source 106 mounted to the housing 107 of the camera. 

The light source 106 may be simply a light-emitting diode and has a slit 108 arranged to collimate 
the output of the light source to produce a beam of light, shown as a dotted line in Fig. 7. The light 
source 106 is arranged on one side of the optical axis O to direct the beam of light perpendicular to 
the optical axis onto the reflective surface 105 of the block 104. The reflective surface 105 is 

25 arranged to reflect the beam of light onto the image sensor 22. As a result of the reflective surface 
105 extending at an angle greater than 0° to the optical axis O along which the lens 100 is 
movable, movement of the lens arrangement 21 causes the position at which the light beam strikes 
the image sensor 22 to vary, as shown by the arrow A. 

The position of the light beam on the image sensor 22 is detected by analysing the image 

30 signal output by the image sensor 22. This analysis is performed by a signal processor 109 which 
detects the position of the light beam which is straightforward because the light beam has a 
distinctive shape in the image signal. The signal processor 109 outputs a position signal 
representing the position of the lens arrangement 21. 

The angle of the reflective surface 105 may be altered to vary the rate of movement of the 

3 5 beam of light across the image sensor 22 with respect to the movement of the lens arrangement 2 1 . 
This position detection system has the particular advantage of being simple and easy to 
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implement. The optical components, that is the light source 106 and the block 104, are cheap and 
easily incorporated into the construction of the camera. Similarly, the signal processor 1 09 is 
straightforward to implement either in hardware or in software, for example as part of the 
microprocessor which controls the camera. 
5 Figs. 8 to 1 1 show two modified position detection systems which differ from the position 

detection system shown in Fig. 7 in the arrangement of the block 104 and the light source 106, but 
are otherwise the same. For brevity common elements will be given the same reference numerals 
and a description thereof is not repeated. 

In the first modified position detection system shown in Figs. 8 and 9, the block 104 is 

10 arranged on the outer wall of the lens barrel 101 and the light source 106 is arranged on one side of 
the optical axis O to direct the beam of light perpendicular to the optical axis O onto the reflective 
surface 105 of the block 104. The reflective surface 105 is angled to direct the beam of light at an 
acute angle to the optical axis, onto the image sensor 22. 

In the second modified position detection system shown in Figs. 10 and 1 1, the block 104 

15 is arranged on the outer wall of the lens barrel 101 and the light source 106 is arranged adjacent 
the image sensor 22 to direct the beam of light parallel to the optical axis O onto the reflective 
surface 105 of the block 104. The reflective surface 105 is angled to direct the beam of light at an 
acute angle to the optical axis, onto the image sensor 22. 

Several different techniques may be used to prevent the beam of light affecting the quality 

20 of the image signal output by the image sensor 22. A first technique is for the light source 106 and 
reflective surface 105 to be arranged to strike a normally "dark" area of the image sensor 22 
surround, that is an area not used directly for image capture, but in this case dedicated to detection 
of the lens arrangement 21 position. A second technique is for the amplitude of the light output by 
the light source 106 to be synchronised to the camera sensor frame rate so that either (1) the light 

25 source is only on between image captures or (2) the light source is only on for a small proportion 
of successive frames, for example one frame in every N frames where N is a plural number. A 
third technique is to give the light source 106 a particular characteristic, for example a given 
colour and/or shape which allows it to be easily removed from the image signal in post-processing. 
A fourth technique is for the light source to output light which is outside the visible range but 

30 detectable by the image sensor 22. 

The block 104 and reflective surface 105 may be replaced by other optical elements which 
have the effect that the light incident on the image sensor 22 varies with movement of the lens 
arrangement 21. For example, the reflective surface may be formed in a prism. Another example is 
to replace the block 104 by an optical element such as a lens which causes the size of the light 

35 beam incident on the image sensor 22 to vary, rather than the position. 

In the camera 20 described above, the measure of the focus quality is the amount of data of 
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the encoded signal output by the JPEG encoder 26 in its second mode of operation. As an 
alternative the camera may use a measure of the focus quality based directly on high spatial 
frequency content of an image, for example by high-pass filtering the image signal and then 
obtaining a measure of the amount of high spatial frequency components, for example by 
5 integrating the modulus of the components or by calculation of the power. 

The high-pass filter may be implemented in the frequency domain. One possibility is to 
perform a discrete cosine transform, eg on 8*8 pixel blocks. Then the measure of focus quality 
might be derived by multiplying the spatial frequency components by the frequency domain filter 
coefficients, and then taking the sum of absolute values of the result. This approach is 
10 computationally cheaper than a power calculation and is nearly as useful. 

The design of the high-pass filter is important. With the assumption that we can only work 
with the blocks that we are given at the output of the image sensor 22, (ie not reconstruct the 
original image and do spatial processing on it), the following can be said about the requirements 
for this filter: 

1 5 • The DC coefficient must be zero as the DC signal never conveys useful focus information 
Very high frequencies are likely to be dominated by pixel noise (if this can be proved by 
analysis of the circle of confusion of a particular system, that would be very helpful information). 
These frequencies should also be attenuated. 

Intermediate frequencies will contain the useful focus information 
20 The transition bands between these zones should not be too abrupt, otherwise they could 

act as a threshold, and prevent the algorithm working under some circumstances. 

Designing frequency domain filters from spatial prototypes is one way to get satisfactory 
results. Knowing what convolution operation is needed in the spatial domain, this can be 
transformed into a frequency domain multiplication. 
25 One possible high-pass filter is the Laplacian of a Gaussian filter as described above. 

This method in its entirety produces quite satisfactory results and compares well in simulation with 
other methods (some frequency based, some spatial based). 

Of course many variations to the embodiments described above are possible within the 
scope of the present invention. Some examples of variations will now be described, but these are 
30 not limitative. 

The measure of focus quality may be generated from the entire area of the image of from 
one or more predetermined parts of the area of the image. In the case of using plural parts of the 
area of the image, the region with the best discrimination of focus may be selected, or an overall 
measure could be derived from the measures for each part, for example by a weighted sum. 
35 Some of the arrangements described above use a piezoelectric actuator as part of the focus 

control, in particular to drive movement of a variable focus lens arrangement. With such a 
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piezoelectric actuator, relatively high drive voltages are typically required to activate the 
piezoelectric material, because such materials typically require drive electric fields of between 
500V/mm to several thousand volts per millimetre, and because very thin piezoelectric layers (say 
20um to 60um or even less) are technically difficult to achieve. So for example, a material 

5 requiring lOOOV/mm drive field and where the layers are lOOjim thick requires a drive voltage of 
100V. In portable and other battery operated equipment such high voltages are generally 
unavailable and it becomes necessary to generate these voltages from the low battery voltages 
commonly available (e.g. between 2V and 6V). It is further necessary to control the high voltage 
drive to the actuator, with some kind of high-voltage amplifier. 

10 In a portable device such as a mobile-phone or cell-phone, a portable digital assistant 

(PDA), a laptop computer or a portable hard drive storage device, the cost of components, space 
taken up by components and weight of components are critical items for the acceptance of any 
devices in these applications. Most standard semiconductor ASIC processes are optimised for low 
voltage circuitry so it is in practice difficult to integrate the high voltage generator circuitry and/or 

1 5 the high voltage drive amplifier circuitry, within other silicon integrated circuits inside the portable 
device. 

To solve this problem, it is possible to provide a single small silicon integrated circuit 
incorporating (1) all the necessary semiconductor elements required for the conversion of a low 
voltage battery supply (typically less than 12V, or less than 6V, or even less than 3 V or 2V) to a 

20 high voltage adequate to supply a high voltage amplifier for driving a piezoelectric actuator device 
(typically more than 12V, or more preferably more than 20V, or even more preferably more than 
40V or even more than 75V) and (2) all the semiconductor elements required to provide the high- 
voltage amplification required to directly drive the piezoelectric element. Such a composite voltage 
step-up and amplifier/controller may be optimised for very low power consumption ( typically less 

25 than 250mW or preferably less than lOOmW or more preferably still less than 50mW or even less 
than 20mW). It may also have a very small package size (typically less than 10mm square or 
preferably less than 5mm square or more preferably less than 3mm square or even less than 2 or 
1mm square). Such a silicon chip may be applied to any of the embodiments described above 
which employ a piezoelectric actuator. In general it may be applied to any portable electronic 

30 device which employs a piezoelectric actuator for any purpose. 



